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SIGNAL  PROCESSING  FILTERS  UNDER 
MODELING  UNCERTAINTIES 


Saleem  A.  Kassam,  Tong  Leong  Llm  and  Leonard  J.  Clmlnl 

ABSTRACT 

Matched  and  Wiener  filters  are  considered  for  signal  processing  applications 
when  the  a  pKi.o'U.  Information  about  signal  and  noise  characteristics  are  not 
completely  specified.  The  approach  is  to  design  filters  which  are  saddle-point 
or  max-min  solutions  for  the  criterion  functional  (mean-squared-error  or  signal- 
to-noise  ratio)  over  the  classes  of  allowable  signal  shapes  and  signal  and 
noise  spectral  densities.  Two-dimensional  discrete-parameter  processes  are 
considered,  and  some  numerical  examples  are  presented. 

"\ 

I,  INTRODUCTION 

Classical  formulations  of  signal  processing  problems  assume  that  the 
characteristics  of  signals  and  noise  can  be  modeled  exactly,  either  deter¬ 
ministically  or  statistically.  For  example,  if  the  shape  of  a  deterministic 
signal  is  known  and  the  noise  additively  corrupting  it  has  a  known  power  spectral 
density  (PSD),  then  a  filter  maximizing  the  signal-to-noise  ratio  (SNR)  at 
its  output  can  be  designed;  this  results  in  the  well-known  matched  filter. 

In  the  same  way,  the  optimum  Wiener  filter  can  be  obtained  for  the  best  linear 
estimate  of  a  random  signal  in  additive  noise,  when  both  PSD's  are  known. 
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In  many  applications  It  Is  much  more  reasonable  to  assume  that  the  signal 
and  noise  characteristics  are  net  completely  known,  and  to  assume  that  they 
can  only  be  defined  as  belonging  to  appropriate  classes  of  characteristics. 

The  sizes  of  these  classes  reflect  the  degrees  of  uncertainty  that  one  has 
about  the  true  signal  and  noise  characteristics.  In  such  cases,  it  is  desirable 
to  have  filters  which  perform  well  over  both  classes  of  allowable  signal  and 
noise  characteristics,  that  is,  we  should  look  for  robust  filters. 

In  general  the  specification  of  an  optimum  filter  for  processing  Inputs 
requires  knowledge  of  the  multivariate  probability  distribution  functions 
characterizing  the  input  random  processes.  For  estimation  and  detection  ap¬ 
plications  under  the  widespread  assumption  of  Gaussian  input  processes  the 
optimum  filters  are  generally  linear,  and  are  based  on  the  bivariate  density 
functions,  that  is,  the  mean  and  covariance  functions,  of  the  input  Gaussian 
process.  Even  if  the  input  processes  are  not  Gaussian,  a  restriction  to  linear 
filtering,  as  in  Wiener  and  matched  filtering,  allows  optimum  filters  to  be 
obtained  if  mean  and  covariance  function  information  is  available.  In  this 
paper  we  will  be  dealing  with  cases  of  linear  filtering  where  this  bivariate 
information  is  imprecise.  Other  efforts  in  robustness  theory  have  been  con¬ 
cerned  with  the  deviations  from  Gaussian  distributions  which  may  occur  in 
input  processes.  Allowances  for  distributional  Impreciseness  have  led  to  many 
interesting  results  on  robust  nonlinear  structures  in  detection  and  estimation 
theory  te.g.,  1-5];  however,  such  results  deal  almost  exclusively  with  uni¬ 
variate  density  functions  and  hence  "white"  Inputs  because  of  the  major 
analytical  difficulties  which  otherwise  appear. 

One  of  the  earliest  Investigations  of  robust  linear  filtering  ideas  was 
reported  by  Yovits  and  Jackson  in  1955  [6],  They  considered  a  game-theoretic 
problem  of  max-mln  filter  design  for  signal  estimation  in  additive  noise  with 
mean-squared-error  as  the  pay-off  functional,  the  signal  having  constraints  on 
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Its  mean-square  derivatives.  Although  the  realizable  Wiener  filter  was  con¬ 
sidered,  only  for  the  white-noise  case  was  It  possible  to  obtain  explicit  re¬ 
sults.  In  [7]  and  [8]  Nahi  and  Weiss  obtained  "bounding  filters"  for  the 
Wiener  and  Kalman  filter,  which  were  possibly  lower-order  filters  with 
guaranteed  error  performance  for  classes  of  input  characteristics.  More  re¬ 
cently,  Kuznetsov  [9]  obtained  the  saddle-point  matched  filter  for  the  SNR 
criterion;  specifically,  with  the  Fourier  transform  S(u)  of  a  finite  energy 
signal  allowed  to  be  a  member  of  a  class  Cg,  and  for  the  noise  spectral  density 

N(u)  allowed  to  be  a  member  of  a  class  C  ,  the  saddle-point  solutions  were  ob- 

n 

talned  for  the  game  with  pay-off  SNR(S,N;H).  Her>  SNR(S,N;H)  is  the  SNR  obtained 

when  filter  H  is  used  for  signal  and  noise  characteristics  S(u>),  N(u>),  respectively. 

Kuznetsov  obtained  separately  the  robust  filter  for  S(u)>  In  with  N(a>)  known,  and 

for  S(u>)  known  andN(u))  in  C  .  The  class  C  was  the  class  of  f lnite-energv  signals 

n  s 

which  are  within  an  allowable  distance  A  >  0  of  a  nominal  Sq(uj)  characteristic.  In 

the  sense  of  L,  distance.  The  class  C  was  the  "band-model"  class  of  the  spectral 
z  n 

densities  bounded  by  given  densities  i  N^lw),  with  a  total-power  constraint. 

In  [10],  Kassam  and  Lim  obtained  the  structures  of  robust  (saddle-point) 
filters  for  the  Wiener  filter  formulation,  with  both  signal  and  noise  spectral 
densities  allowed  to  be  members  of  classes  of  densities  specified  by  "band-models". 

In  [11],  Poor  generalizes  some  results  on  Wiener  filters  obtained  in  [10]. 

Here  we  will  obtain  the  robust  matched  and  Wiener  filters  for  two-dimensional 
discrete-parameter  systems  subject  to  uncertainties  simultaneously  about  signal 
and  noise  characteristics.  Thus  this  work  represents  a  logical  extension  of  the 
recent  results  in  [9-11], 

II,  ROBUST  MATCHED  FILTERES 

Let  s(m,n)  be  a  real,  finite-energy,  two-dimensional,  deterministic  signal 
sequence,  where  m,n  are  Integer  variables,  and  let  S(u,v)  be  the  two-dimensional 
discrete-time  Fourier  transform  of  s(m,n).  If  N(u,v)  Is  the  PSD  of  a  real,  statlon- 

JY 

jsmmmmm  cqk$_ 

linl  '< ■  Mil  ii'(T  oi  JH‘LCIAjL_ 

A 


o  □ 


«ry,  zero-mean,  additive  noise,  then  the  matched  filter  with  frequency  response 

H+(u,v)  -  S*(u,v)/N(u,v)  (1) 

maximizes  the  SNR  at  Its  output  at  n^O,  n«0.  If  an  arbitrary  filter  H(u,v)  Is 
used,  the  SNR  functional  is 

SNR(S,N;H)  -  v??(>l  t  I  ?  (2) 

2tt  //N(u,v)H(u,v)I  *dudv  '  ' 


In  (2)  and  the  rest  of  this  paper,  except  where  Indicated  otherwise,  every  double 
Integral  la  over  the  region  {u,v| -n<u,  v£ti}  .  In  the  following,  we  will  drop  the 
arguments  of  the  functions  wherever  no  confusion  results. 

Consider  the  following  models  for  the  classes  of  allowable  signal  and  noise 
characteristics: 

Cs  -  {S(u, v)  |  (-l)’JjfS-S0|5  dudv  i&),  (3) 

Cn  «  (N(u,v)  |  N^(u,v)£N(u,v)iN^(u,v)  and  (^j)  jJJn(u,v)  dudv  *  (4) 

In  the  definition  of  C  ,  S  (u,v)  Is  a  nominal  signal  characteristic,  and  signals 

fi  U 

In  C#  differ  in  energy  from  the  nominal  signal  s^(m,n)  by  no  more  than  6.  To 

exclude  a  trivial  case,  we  assume  that  the  energy  T.  E  |  s  (m.n)  |  The  class  C 

la  a  reasonable  model  for  the  allowable  signal  when  It  Is  known  that  slm.n)  Is 

within  a  neigborhood  of  s„(m,n).  The  class  C  of  noise  PSD's  contains  PSD's 

u  n 

with  a  specific  total  power  which  lie  between  given  upper  and  lower  bounds. 
Such  a  model  is  appropriate,  for  example,  when  N(u,v)  is  estimated  from  samples. 
In  the  definition  of  Cn>  we  assume  that  NL(u,v)  is  hounded. 

The  robust  matched  filter  H^(u,v)  is  defined  to  be  the  max-mln  filter  such 

that  max  min  SNR(S,N;H)  -  min  SNR(S,N;H_) 

H  SeC  SeC  R 
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If  Is  Che  optimum  filter  for  a  least-favorable  pair  of  characteristics  SReC 

NBcC  ,  then  we  would  have 
K  n 


s 


SNR(S,N;HR)  i  SNR(SR,NR;HR)  >  SNR(SR,NR;H)  (6) 

for  any  pair  (S,N)  In  C^xC^  and  any  linear  filter  H,  and  (5)  would  be  satisfied. 

In  this  case,  the  filter  H»1L  and  the  pair  (S  ,N  )cC  *C  will  form  a  saddle-point 

K  K  K  s  n 

for  the  SNR  functional  of  (2). 

The  main  result  of  this  section  Is  the  following  theorem,  which  gives  the 
saddle-point  solution  for  our  matched  filtering  problem: 

Theorem  1.  For  the  classes  C  and  C  .  the  robust  matched  filter  H_  Is  the  optimum 

s  n  K 

filter  for  the  pair  of  least  favorable  characteristics  defined  by 

S„(u,v)N  (u,v) 

SR  '  NrTu7v~>  I—  (7> 

and 

(  Ny(u,v)  ,  (u,v)eR^(k) 

Nr  -  1  Nl(u,v)  ,  (u, v)cR^(k)  , 


I | SR(u,v) l /k  ,  (u,v)cR^(k)  (8) 

where 

Ry(k)  »  {(u,v)|kNu  <  | SR| }  ,  (9) 

RL(k)  -  { (u,v) J | SR|  <  kN^}  ,  (10) 

Rjjfk)  -  ( (u, v)  |kNL  <  |SR|  S.  kNy}  ,  (11) 

if  non-negative  constants  k,c  exist  satisfying 

c*  f  T I  ^0 1  dudv  ■  6  ,  (12) 

■(HF 


and 
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J/N^dudv  +  JjNydudv  +  ~  JJ|SR|dudv  » 

\<k)  Vk>  RM(k) 


We  omit  the  detailed  proof  of  the  theorem,  since  it  is  somewhat  lengthy.  However, 

some  clarifying  comments  can  be  made,  and  an  outline  of  the  proof  follows. 

The  structure  of  the  solution  is  suggested  by  the  results  given  in  [9,10]. 

Eq.  (12)  results  from  conditions  Imposed  in  defining  Cg,  and  (13)  is  the  power 

constraint  for  the  class  C  .  Note  that  (7)  and  (8)  are  coupled,  but  that  S„ 

n  R 

and  NR  can  be  expressed  in  terms  of  the  known  Sq,  N^,  and  N^,  and  constants  k 

and  c,  which  can  be  solved  from  two  simultaneous  equations  derived  from  (12) 

and  (13).  The  proof  shows  when  such  a  solution  for  k  and  c  will  exist.  The 

saddle-point  condition  (6)  can  be  verified  by  noting  that  is  optimum  for 

SR  and  NR  [one  part  of  (6)],  and  by  showing  that  (SR,HR)  minimizes  the  numerator 

in  (2)  over  all  (S,H„)  with  SeC  ,  (N_,H_)  maximizes  the  denominator  in  (2)  over 
R  S  R  R 

all  the  (N.ty  with  NeCn. 

For  the  case  where  either  5”0  or  N^  •  N^  the  above  results  become  somewhat 
simpler.  Theorem  1  also  gives,  as  a  special  case,  the  robust  filter  for  a  dif¬ 
ferent  model,  the  e-model  [10],  for  N(u,v).  We  will  consider  this  model  in  a 
simple  example  in  the  next  section. 


Outline  of  Proof  of  Theorem  1 


Since  Hr  is  the  optimum  filter  for  the  pair  <SR»NR).  we  have  £o  show  only  that 
SNR(S,N;HR)  >  SNR(Sr,Nr;Hr)  for  all  (S.N)  in  C#*Cn. 

Consider  the  denominator  term  in  (2).  and  call  it  d(N,H).  Now 

ddl.V-d  (V  V-*2  (N~NR)+  (k)  (N-NL)  I  Hr  1 2  +  R^k^V  IHr|2  <l4) 


On  R^k),  I^l1  <  k2  and  on  Ry(k),  |hr|!  a  k2;  thus  using  the  power  constraint,  we 
find  d(N,HR)-d(NR,HR)  <  0. 

In  showing  that  the  numerator  term  in  (2)  is  minimized  for  S«SR  given  that 

we  note  that  i /  (S*S/(NR+c)  ]  is  non-negative,  and  we  consider  the  minimization 

of  /i[Si(S-Sn)/(ND+c)].  This  last  term  is  real,  so  we  consider 
0  U  K 


This  term  is  a  minimum  when  the  cosine  part  is  -1,  and  the  result  of  (7)  for  the 
minimizing  S  can  be  obtained  from  Schwarz's  inequality. 

In  order  to  show  when  the  solution  given  by  (7)  and  (8)  exists,  that  is, 
when  non-negative  constants  c  and  k  exist  which  are  solutions  to  (12)  and  (13), 
we  rewrite  Eqs.  (12)  and  (13)  as 


(15) 


(16) 


(17) 


where  R^k)  of  Eq.  (10)  has  been  written  explicitly  as 
v*.  c)  -  {(u,v)  ||sq|Nl  <  kNL(NL+c)>  . 

end  similarly 

Ryfk.c)  -  {(u,v)jkNu(Nu+c)  <  |S()|NU  and  >  0}  .  (18) 

^(k.c)  -  ^(k.c)  fi  Ryfk.c)  (19) 


Suppose  the  condition 


j/l SQ| 2dudv  < 

(2w)J6  <  JJ|S0I 

:dudv  +  |||S^|Jdudv 

(20) 

v° 

V0 

V° 

V 

la  satisfied.  This  will  be  true  in  many  models  of  Interest;  It  is  valid,  for 
example,  when  and  are  finite  and  non-zero  when  |Sg|  is  positive.  Then 
there  exists  a  finite,  positive  solution  c»c^  in  Eq.  (12)  with  replacing 
N^,  and  there  exists  also  a  finite,  positive  solution  c-c^ic^  in  the  equation 


f/lsj’dudv  +  cJ 

v° 


(2n):5 


(21) 


If  the  set  {(u,v)  (Ny-N^)N^I  Sq| '0)  has  positive  measure,  then  c2''c^-  Otherwise, 


c2*cr 

Consider  Eq.  (16).  Let  k«kg(c)  be  the  solution  for  k  with  celc^.c^].  For 
c«c^,  we  define  kg(c^)  as  the  ess  sup  over  the  set  { (u,v)  |  N^|  Sq|  ">0}  of  |  SQ|  /  (N^+c  j) , 
and  for  c«Cj  we  define  kg(Cj)  similarly  as  the  ess  inf ,  over  the  same  set.  of 
|Sq| /(Ny+Cj) .  The  solution  kg(c)  is  a  smooth,  non-increasing  function  of  c  on 
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Suppose  the  condition 


(2u)*o^  <  Jj NLdudv  +  jjNydudv 


|s0l-° 


|s0IV° 


(22) 


la  satisfied.  This  Is  also  generally  true.  Then  the  solution  k-k^tc)  with  cttcj.c,) 

for  Eq.  (15)  exists,  and  we  have  k  (c,)  <  k  (c,)  £  k  (c.)  <.  k  (c.).  (Note  that 

s  *  n  1  nl  si 

(22)  Is  not  compatible  with  Cj-c^O,  given  that  {Js^dudv  (2 t)j6  <  {{NLdudv). 

The  solution  kR(c)  Is  also  a  smooth,  non-increasing  function  of  c  on  [c^.c,].  Thus, 
positive  solutions  k,c  always  exist,  when  (20)  and  (22)  are  satisfied,  for  the 
simultaneous  equations  (12)  and  (13). 

If  (20)  is  true  but  (22)  is  not,  we  may  pick  NR*NU  when  !Sq|Nl>0,  Nr*0 
when  N^-0  and  | Sq | >0 ,  and  NR  arbitrary  otherwise,  with  SR  as  in  Eq.  (7)  and  c-c^. 
Similar  special  cases  can  be  considered  when  (20)  is  not  satisfied,  for  example  when 
\  ia  unbounded  everywhere. 

If  the  set  { (u,v)  |  (Ny-N^)N^I  Spl ''O)  has  measure  zero  (for  example,  N^-N^)  and 
5>0  we  take  c^c^-c^  (assuming  the  LHS  Inequality  in  (20)  is  valid,  otherwise  the 
solution  Is  trivial) and  NR*N^  when  |Sq|n0,  arbitrary  otherwise.  If  6*0  and 
{ (u,v)  |  (Njj-N^)Nl|  Sq|  >0}  has  positive  measure,  we  can  set  c*0  and  take  k-kn(0) 
the  finite,  positive  solution  of  Eq.  (15),  assuming  (22)  Is  true  (otherwise 
the  solution  is  trivial).  We  will  consider  another  special  case  In  the  next 
section. 


III.  A  NUMERICAL  EXAMPLE 

We  will  now  consider  a  simple  specific  model  for  the  signal  and  noise  character¬ 
istics  and  derive  some  numerical  results.  Consider  the  case  where  N(u,v)  and  S(u,v) 
are  circularly  symmetric,  so  that  we  may  express  N(u,v)  as  N(r)  and  S(u,v)  as 
S(r)  where  r  *  /u‘+  vi  .  We  define  a  particular  nominal  signal  Fourier  transform 

by 


o 
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s0(r> 


0  <  r  <  2.5 
r  >  2.5 


(23) 


In  our  first  example,  we  will  assume  that  we  have  precise  information  about  the 
noise, 


N(r)  -  NQ(r) 
-  NL(r) 

■  Vr> 


( 2.5-r,  0  <  r  <  2.5 

|  0  ,  r  >  2.5 


(24) 


If  we  take  6-0.55,  which  represents  an  uncertainity  of  about  7X  of  the  total 
signal  energy,  we  can  easily  solve  for  the  value  c-0.1.  Thus  we  have 
/ 


SR(r) 


4,0(2. 5-r) 

2.6-r 

0 


0  <  r  <  2.5 
r  >  2.5 


(25) 


V 

and  the  robust  filter  is 
/ 


HR(r) 


I 

\ 


4.0 

2.6-r 


0 


0  1  r  1  2.5 
r  >  2.5 


(26) 


1 

The  effect  of  the  6-uncertainity  in  the  signal  definition  thus  prescribes  a  filter 
designed  on  the  assumption  of  an  added  white-noise  component  of  level  0.1  for 
the  noise  spectrum.  This  white-noise  components  results  in  a  non-singular  signal 
detection  solution,  whereas  the  "optimum"  filter  Hq  designed  for  the  nominal 
signal  Sq  and  noise  N  results  in  a  theoretically  infinite  SNR(Sq,N;Hq) .  However, 
if  Hq  is  used  when  S+Sq,  we  could  get  very  different  results.  For  example,  it 
turns  out  that  SNR(SR,N;HQ)  -  dB,  but  with  HR  we  get  SNR(SR,N;HR)  «  10  dB, 
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f>- 


which  fores  the  lower  bound  for  performance.  When  HR  Is  used  and  the  nominal 
signal  Is  In  effect,  we  get  SNR(Sq,N:Hr)  -  14  dB. 

To  extend  this  example,  let  us  Introduce  distinct  upper  and  lower  bounds  for 


N^(r)  -  (1-e)  NQ(r)  , 

(27) 

n 

w 

1 

e 

(28) 

wlthca  0.1  and  noise  variance  assumed  known  to  be  the  variance  of  N^fr),  the 
''nominal"  noise  spectrum.  This  model  may  be  Interpreted  as  expressing  a  90* 
confidence  in  the  validity  of  Ng(r)  for  the  noise  spectrum,  with  an  arbitrary 
noise  component  allowed  otherwise.  In  order  to  obcaln  SR  and  NR,  c*Cj  was  first 
found  as  the  solution  of  Eq.  (12)  with  N,  replacing  N  .  The  correct  c  has  to  be 
larger  than  this.  The  solution  k-k^c)  for  c  >  c^  in  Eq.  (16)  was  then  computed 
numerically.  Similarly,  the  solution  k»kn(c)  for  c  >  c^  was  computed  numerically 
for  Eq.  (15).  The  intersection  of  these  two  results  gave  the  value  of  c»0.23  and 
k"5.9.  These  results  give 


and 


NR(r) 


0.9(2 . 5-r) 
0.45 

,  0 


0  1  r  1  2.0 
2.0  <  r  <  2.5 
r  >  2.5 


SR(r)  - 


3. 6(2. 5-r) _ 

0.9^2. 5-r)  +  0.23 


0  5  r  <  2.0 


2.65 

0 


,  2.0  <  r  <  2.5  . 

,  r  >  2.5 


(29) 


(30) 


so  that 


-  12 


t> 


|  2.5-0.9r  ’  0  -  r  "  2>0 

Vr)  -  \  5.9  ,  2.0  <  r  <  2.5 

>  0  ,  r  >  2.5 


(31) 


Figure  1  shows  a  sketch  of  these  functions.  Numerical  values  for  SNR's  can  also  be 
computed  for  this  case  of  signal  and  noise  uncertainity ;  the  robust  filter  lower 
bound  on  SNR  will  now  be  somewhat  less  than  10  dB,  because  of  the  additional 
noise  uncertainity. 
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iv.  ncmusT  wifnfk  mms 

Let  S(u,v)  now  bo  the  PSD  of  a  real,  wide-sense  stationary  random  signal 
observed  (in  a  mixture  with  real,  wlde-sense  stationary,  tern-mean,  additive 
noise  with  PSD  N(u,v).  It  is  well-known  that  thp  optimum  linear  flttpr  giving 
thp  minimum  mean-squared-error  iMSKl  estimate  of  thp  signal  la  nlvrn  bv 


„t.  .  S(u.v) 

H  (u'v)  ’  sTiT.vTfNiTi.iT 


Oil 


without  reallxahilttv  constraint a . 

In  general,  If  an  arbitrary  flltor  H(u,v)  la  used,  thp  MSF  la  given  bv 

e(S,N;H)  ■  ( jjjl  *  JJlS(u,vl  |  l-Hln,  vl  |  ♦  N(u.vl |H(u,vl |  I  dudv  OH 
and  thp  minimum  MSF  la  given  by 


e+(S,N)  -  PlS.NjH1) 


0*1 


Wp  would  like  to  consider  a  method  for  designing  the  eatlmat  Inn  flllpr  Mlu.vl 
when  the  PSD'a  of  the  signal  and  uolap  processes  are  not  prec I ap  1  v  known.  The 
approach  which  will  bp  fol lowed  la  a  direct  extenalon  of  thp  one-dlmenslonal 
caae  given  In  flOJ. 

We  now  aasumc  that  both  the  signal  and  notae  PSD'a  belong  I o  upper-low* r 
bounded  claaaea  of  the  form  of  v41,  Thus  we  now  have  thp  allowable  atgn.il  and 

notae  PSD'a  to  bp  mombets  of  claaaea  0  and  D  defined  bv 

a  n 


D 

a 


a  J 

(S(u,v)  Sj(u,v)  1  S(u,vl  1  S(|(u,v>  and  (y^l  //siu.vldudv  - 


1<M 


and 


D  «  C  0*1 

n  n 

where  C  waa  defined  In  (4).  We  assume  that  the  upper  and  lower  bounds  and 
n 

the  total  powers  of  the  signal  and  notae  processes  are  known,  with  S,(u,v)  and 
*L(u  ,v)  hounded. 


The  most  robust  filter  llR(u,v)  is  defined  as  in  (5),  but  now  we  require 

the  minimization  of  the  MSE  rather  than  maximization  of  SNR.  If  HR(u,vl  Is 

the  optimum  filter  for  a  pair  of  least  favorable  PSD's  S  ill  ,  N  il)  ,  then  N  (u 

K  n  R  n  R 

mimt  satisfy 

«(S.N;Hr)  1  VV  <  e(SR.NR;ll)  (37) 

for  any  pair  (S.N)  In  D  >D  and  any  linear  filter  H(u,v).  The  filter  H„(u,v) 
and  the  least  favorable  pair  SR(u,v),  NR(u,v)  will  form  a  saddle-point  for 
the  MSE. 

The  main  result  is  the  following  theorem: 

Theorem  2.  For  the  classes  D  and  D  ,  the  most  robust  Wiener  filter  H. (u.v) 

s  n  K 

exists.  It  Is  the  optimum  filter  for  the  pair  of  least  favorable  PSP's  defined 
according  to  the  following: 
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aj(Vg)  ■  {(u.v)  |  SL(u,v)  <  k^N^u.v)  *  S^Cu.v)}  , 

a2(Wg)  ■  {(u,v)  |  S^(u.v)  <  Sy(u,v)  <  kRNL(u,v))  , 

3  (kg)  5  {(u.v)  |  SL(u,v)  £  k8NL<u<v^  • 

et(kn)  ■  {(u.v)  I  kftNL(u,v)  <  SL(u,v)  <  knNu(u,v)}  , 

s  {(U.v)  I  k^N^(u.v)  s  k^NyCu.v)  <  SL<u,v))  , 

S  (k^)  -  {(u.v)  |  k„NL<u.v)  >  SL(u,v)}  .  (40) 

If  solutions  kg  <  k^  exist  to  the  power  constraint  equations 


PS(,) 

V*> 


4 

°N 


(41s) 

(Alh) 


where 

P.(«)  -  (5^ > *  l  fl  *N)  (u.v)vlmtv  +  f[  S()(u,v)  dudv 

0^(1)  '  o2(r) 

♦  11  S. (u, v)dudv 1  ,  (42a) 

a(s)  L 

Pu(s)  •  (s^)!(  11  -  S  (u.v) dudv  +  If  N,  (u.v)  dudv 

N  2n  D^*)*  L  82(»)  u 

+  11  N.(u.v)dudv)  (42h) 

B(«) 


There  are  two  parts  to  the  proof  of  the  theorem,  one  showing  the  robustness 
of  the  solutions  and  the  other  showing  existence.  The  existence  proof  which 
depends  on  finding  a  solution  to (41)  or  other  equations  la  similar  to  that  giver  in 
(10)  and  will  be  omitted.  The  robustness  proof  la  simpler,  and  we  will  outline  it  here. 

In  order  to  show  that  the  above  solution  satisfies  the  condition  for  robust¬ 
ness,  we  must  show  (as  in  liol)  that 


s(S,H;Hr)  -  e(SR,NR;HR)  <  0 


(43) 


when  V“  ,v)  Is  the  optimum  filter  for  SR(u,v)  and  NR(u,v). 
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We  can  consider  Che  two  terms,  signal  and  noise.  In  (33)  separately. 

Define 

Aeslgnal  5  (A)J^1S(U-V)-SR(U*V)IIKS7^P  dUdV  (A4) 

°n  OjtVg).  Sr/Nr  -  ks  and,  on  6^^),  SR/NR  -  k.n  so  that  1/(1+SR/NR)  i  l/(l+kg). 

On  (^(kg).  (S-SR)  ls  non-positive  and  SR/NR  i  k8  so  that  1/(1+SR/NR)  2  l/(l+kg) 

and,  on  0,(k  ),  the  Integrand  is  non-negative  and  1/(1+S  /N  )  1  l/(l+k  ). 

i  n  K  K  s 

Finally,  on  the  rest  of  the  (u,v)  plane,  SR/NR-SiyN^-kg  a,’d  ll'e  integrand  ls 
non-negative.  Thus, 

Signal  -  (^)?(rfJ;)JniS(u.v)-SR(u.v)]dudv.  (45) 

and  from  the  power  constraint  we  get 

Aeslgnal  ”  ®  (46) 

In  a  similar  way,  the  noise  term  can  be  shown  to  be  non-positive  and  robustness 
ls  proved. 

Notice  that  although  Theorem  2  asserts  the  existence  of  a  least-favorable 

pair  of  PSD' s,  it  only  defines  them  for  a  particular  case  when  the  equations  in 

(41)  have  solutions  with  k<k  .  This  also  turns  out  usuallv  to  be  the  case. 

s  n 

Otherwise,  the  least-favorable  densities  can  be  obtained  directly  from  the 
detailed  version  of  the  theorem  in  (10|  tor  the  one-dimensional  case. 

This  theorem  specifies  the  least-favorable  spectral  densities  as  a  pair  of 
spectral  densities  which  tend  to  be  as  similar  as  possible,  within  the  given 
classes.  This  is  apparent  from  (38)  and  (39),  and  is  a  reasonable  solution 
from  Intuitive  considerations.  In  fact,  it  is  possible  to  prove  that  in  a  gen¬ 
eralised  sense  of  "distance"  between  two  spectral  densities,  the  solution  of 
Theorem  2  species  the  minimum  distance  pair  (12], 
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It  ahould  bo  noted  that  the  result  of  Theorem  2  can  also  be  applied  to 

another  pair  of  classes  K  and  E  for  the  signal  and  noise  PSD's,  defined  bv 

s  n 

»  (S(u,v)  |  S(u,v)  -  (l-E#)S0(u,v)  ♦  E^S^lu.v)  and 

/ / Sq ( u,v)dudv  •  fj Sc(u,v)dudv)  (4D 

and  almtlarlv  for  E  .  Here  S,,(u,v)  Is  a  known  nominal  signal  spectral  densitv, 
n  u 

C  la  an  assumed  degree  of  contamination  allowed  for  S,.(u,v),  and  S  (u,v)  Is  an 

i  u  c 

otherwise  arbitrary  spectral  density.  With  S^(u,v)  •  (1-r^)  Sq(u, v)  and  S^(u,v) 
everywhere  unbounded  In  (35).  the  class  1)^  becomes  the  above  .  Numerical 
results  for  such  classes  in  the  one-dlmenslonal  case  given  In  llol  show  the 
uaefulness  of  these  concepts  of  robust  Wiener  filtering. 


V.  CONCLUSION 

A  design  philosophy  for  filtering  signals  In  noise  has  been  presented, 
applicable  In  cases  where  signal  and  noise  characteristics  cannot  be  modeled 
precisely.  The  robust  matched  and  Wiener  filters  have  been  derived  for  two- 
dimensional  discrete-time  applications.  Such  filters  can  be  useful  In  many  two- 
dimensional  signal  detection  and  estimation  applications. 
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